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Evaluation of Bar Examination 
Procedures*® 


Survey of Bar Examination System and Law School Training 
Within a State by An Experienced Out-of-State Board 


By JosepH A. McCuain, JR. 
Dean, Duke University School of Law 


Recent studies made and reported in the Survey of the Legal 
Profession show quite clearly the great disparities that exist among 
the different bar examination systems in the United States. The gamut 
is run in such systems from the almost primitive to the most advanced 
and admirably designed. The great divergencies in the quality and 
character of bar examination systems are enough to make anyone 
despair who is seriously interested in sound legal education and proper 
standards for admission to the bar, because the two are inextricably 
related. There is no doubt that poorly devised and operated bar 
examination systems constitute one of the most significant obstacles 
to sound and adequate legal education which must form the basis of 
a properly trained bar. 





*A panel discussion at the annual meeting of The National Conference of 
Bar Examiners in San Francisco, September 16, 1952. 
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So great and obvious have been these disparities among the bar 
examination systems that many of us have urged for a number of 
years the development of a national standard bar examination as a 
means of insuring an adequate and uniform test for admission to the 
bar. As desirable as such an examination may be, we must be realistic 
in appraising its chances for general acceptance at any time in the 
immediate future. General acceptance of such a system will eventually 
come, it is hoped, but unfortunately it seems to be a long range pros- 
pect. In the meantime, we should certainly take all reasonable steps 
to advance the development and acceptance of such a system and I 
know of no better promotional work than the encouraging of periodic 
surveys by an impartial, competent group of the legal educational 
facilities and bar examination systems of each state. 


Here I would like to interject one of my pet peeves. We have 
argued for several years as to what should be expected in an applicant 
for admission to the bar. It is sheer nonsense to me to hear a person 
declare that admission certifies the full competence of the young 
lawyer to handle any and all cases that may come to him. That cannot 
be truthfully said of the finest lawyer in this room, but it can be said 
that he will possess the fundamental mental and legal thinking equip- 
ment to perform an adequate job after full study of the problem, and 
this may actually involve the calling in of an expert in the particular 
field involved to assist. Any lawyer who claims to be capable of 
handling, for example, intricate and complicated tax problems without 
special and long study of the field is, in my opinion, deceiving himself 
and his client. 

We forget too often that the bar examiners in two or three days 
are trying to determine what the law school has been trying to do 
for three years. The covering of twenty to thirty subjects on bar 
examinations is to me wholly unjustified and defeats the very purpose 
of testing fairly thoroughly the mental and legal equipment of the 
student, which can be done just as well in a thorough test in a half 
dozen subjects or less. For this reason, I believe that a national stand- 
ard bar examination is thoroughly feasible and would be a great step 
forward. 

It has been my own observation in dealing with bar examiners 
in several states that they are honest, sincere lawyers, trying to do 
a reasonably good job with the finances and means available to them, 
which in all too many cases are woefully inadequate. Many of them 
have very little assistance, if any, in the preparation or grading of 
examination questions. Often the examiners will accept new ideas and 
improved methods if they are fully educated as to the worthwhileness 
of such measures and their success in other jurisdictions, provided 
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such measures are financially feasible to employ. All too frequently 
the effort to bring about a new point of view is attempted by law 
teachers associated with local law schools whose motives may be 
questioned, no matter how sound the ideas they may advance. 


It occurs to me that The National Conference of Bar Examiners 
could render a great service by setting up a panel of forty or fifty 
names of persons thoroughly competent to engage in an impartial 
over-all survey of the law schools and the bar examination system of 
any state. Such a list should include, of course, persons who have had 
intimate and first-hand experience with bar examinations and law 
teachers who are thoroughly competent in the field of legal education. 
This must necessarily be true because, in order to have a first-class 
survey made, the surveyors should be composed of at least two, and 
perhaps three, persons who bring to their task expert knowledge both 
in the field of legal education and in that of bar examination stand- 
ards and methods. 

It should be emphasized, at least in the writer’s opinion, that a 
survey, in order to be of real value, must include a comprehensive 
study of every legal education facility in the jurisdiction as well as 
the bar examination system itself. This is true because the educational 
facilities are inextricably linked with the bar examination system, 
and any group of intelligent recommendations to be made must take 
full cognizance of the existing legal educational facilities. There is no 
longer room in the United States for commercial or second rate law 
schools, and it is only the lack of vision and intestinal fortitude on the 
part of the bar and the courts which permits such schools to exist. 
No bar examination, however good, is going to take the place of sound 
and adequate legal education in a particular jurisdiction. 


I believe that this point was well brought out by the survey in 
California in 1949-50 in which I was privileged to participate, along 
with Thomas F. McDonald of St. Louis, Missouri, and the late Sidney 
Post Simpson. In that case we found, as we expected, one of the best 
devised bar examination systems in the country, if not the best, and 
the greatest possible disparities in quality and character of the edu- 
cational facilities available to the prospective lawyer. In fact, the bar 
examination system in that state was being expected to perform an 
impossible task, at least in my opinion, in view of the sad state of 
legal education in California. This does not mean, of course, that there 
were not outstanding and nationally prominent law schools in the 
state, but there existed at the same time some of the worst possible 
examples of law schools still operating in the modern day. It was, 
therefore, inevitable that the bar examiners must flunk large numbers 
of applicants who came to the examination thoroughly unprepared, 
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and it was likewise inevitable that over a period of years many who 
were thoroughly ill equipped in so far as legal training was concerned 
would eventually get by the examination after several attempts. This 
caused us to state in our report that the bar examiners in California 
were really being asked to take their stand on the one yard line, and 
such last ditch stands are notoriously unsuccessful over a long period 
of time. 

The mere fact that every law school in a particular state is com- 
plying with the standards of the American Bar Association, for exam- 
ple, does not guarantee that every graduate of these schools will pass 
a well devised bar examination on the first try. It is submitted, how- 
ever, that if every law school in a jurisdiction is of this standard 
character, the percentage of failures should drop markedly and over 
a period of time cooperative work between the examiners and such 
law school will bring about a condition in which the applicants and 
the bar examination will be of such quality that failures should become 
a matter of news. 

This very development took place in the State of Missouri between 
1935 and 1942. In 1935 sixty-five per cent of all law students enrolled 
in Missouri were in law schools not complying with standards of the 
American Bar Association and the percentage of failures on the bar 
examination, which, by the way, was well devised, ran extremely high. 
The adoption of a rule by the Board of Bar Examiners, with the 
approval of the Supreme Court, that each applicant must show grad- 
uation from an A.B.A. approved school virtually eliminated within a 
period of five or six years all sub-standard schools. The result was that 
the percentage of bar examination failures dropped to an extremely 
low figure. The explanation is, of course, simple—the caliber of the 
applicant during these later years was of a fairly uniform high quality. 

A survey such as has been described here by an impartial board 
of out-of-state experts, if the results can have intelligent support of 
the bar, will do more to advance the cause of legal education and of 
improved bar examination methods than any other single step of 
which I know. It is true that improvements can come from examination 
within the state but for a variety of reasons—political, personal, and 
otherwise—it is very difficult to gain improvement by internal exam- 
ination and inventory. 

I do not believe it to be true that a bar examination is necessarily 
poor because the graduates of reasonably good law schools fail it in 
considerable number, nor do I believe it to be true that law schools 
are poor because they fail a bar examination of the particular juris- 
diction in rather large numbers, but I do believe it to be true that any 
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bar examination system, which over a period of years fails in substan- 
tial numbers the graduates of good law schools, does have something 
wrong with its methods and careful stock should be taken of the 
situation. When this condition exists, it is of course obvious that, in 
order to get a true picture of who is at fault, a thoroughly impartial 
appraisal needs to be made of the situation to ascertain what is the 
condition in legal education as well as in the bar examination system 
of the state. 

A few words about methods of procedure in a survey. If a board 
or committee of two or three persons (and I prefer three) has been 
selected, it is believed that the first significant step in securing neces- 
sary information is the preparation of a comprehensive questionnaire 
designed to elicit as much information as possible in advance of per- 
sonal visits and examination. It is no easy task to prepare an adequate 
questionnaire, but fortunately there are now available several good 
models for guidance. 

Not only must the questionnaire be well devised, but it is equally 
important to be sure that it is completely answered by each school. 
This is not an easy task for adequate and complete answers require 
patience and care in handling each question. 

In ‘the California Survey of 1949-50 the Board decided that with 
sixteen law schools in the state, progress would be greatly expedited 
by having a competent person visit each school and actually aid in 
answering the questionnaire. This procedure enabled the Board to 
secure detailed information from almost every law school, there being 
only one or two which failed to cooperate. A study of this information 
gave each Board member a pretty accurate picture of each school and 
the critical areas on which to center attention when the personal visits 
took place. The length of such visits were greatly shortened by such 
advance information and more time could be spent in visiting classes 
and forming opinions of the atmosphere of the school and the caliber 
of its personnel. The cost of inspection is also lessened by shortening 
the time to be spent on the ground. 

An additional value of such a questionnaire is the protection it 
gives against subsequent complaints by a school that the facts con- 
cerning it are not accurately stated. It is comforting in such a situation 
to have the signature of the proper school official on the questionnaire 
attesting the accuracy of the information submitted. 

It must be recognized that inadequate finances make it difficult 
in some states to secure a first-rate survey by an outside competent 
board or committee. If, however, this Conference, for example, could 
offer at least a large panel of interested and competent persons from 
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which selections could be made by any jurisdiction interested in a 
survey, and also undertake to give counsel and guidance to any 
jurisdiction so interested, it is believed that more states would be 
willing to have such surveys made. Expenses of a survey could be 
held down in substantial measure by the selection of competent persons 
living within a reasonable distance from the locale of the survey. 

In conclusion, it appears that the values to be expected from 
periodic surveys of legal educational facilities and bar examination 
systems are sufficiently great to warrant an organized effort by this 
Conference to make such undertakings as simple and inexpensive as 
possible to those states interested in taking stock of their own situation. 
It is further believed that, as adequate surveys are made, we shall grow 
closer to the time when some standard national test may be devised 
and accepted by many states. 


Publication of Bar Examination Statistics 


By Harry NADELL 
Chairman, New Jersey Board of Bar Examiners 


This topic is one part of a larger subject, Evaluation of Bar Exam- 
ination Procedure. Dean McClain has discussed the evaluation problem 
from the point of view of outside diagnosis of the bar examination by 
an out-of-state board. My topic, Publication of Bar Examination 
Statistics, looks at the problem of evaluation from the point of view 
of self-examination, by cooperation between a board of bar examiners 
of a certain state and the law schools of that state. 

The term “publication” in connection with bar examination statis- 
tics will be used in the sense of releasing information to the law schools. 
We are using the term in the same sense as we do in libel and slander. 
We hope, though, that the nature of the statistics released by a 
particular board of bar examiners will not be considered defamatory 
by the local law school whose graduates took the bar examination. 

In concluding his discussion in the Survey of the Legal Profession 
relating to Bar Examinations and Requirements for Admission to the 
Bar, Professor Harold Shepherd makes the following significant state- 
ment (p. 380): 

“The bar examiners’ function should not be viewed in isolation. 
It is only a part of the process, a segment of a larger and more basic 
problem: Who shall be permitted to practice law? 

“Any adequate solution of this problem is the joint responsibility 
of bar examiners and the law schools. The need for close cooperation 
and mutual understanding between the two groups is self-evident. 
The results of the survey make it abundantly clear that most of the 
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criticisms each group can make of the other would largely disappear 
if there were clear realization of the unity of function, and if oppor- 
tunity were provided for free interchange of information and con- 
structive criticism.” 

One important way for the bar examiners to cooperate with the 
law schools is to release information to them as to the success of their 
graduates in the bar examination. 

Professor Shepherd made a survey of the extent to which the 
bar examiners informed the law schools of the success or failure of 
their graduates in the bar examinations, by sending out questionnaires 
to law school deans all over the country. The result of his survey is 
published at p. 379 of the book just mentioned. 

In his questionnaire, Professor Shepherd asked this question of 
the law school deans: “Are you furnished with statistics showing the 
success in the bar examination of the students from your law school?” 

Deans in fifteen states replied yes (Arizona, California, Colorado, 
Illinois, Indiana, Louisiana, Maryland, Massachusetts, Minnesota, North 
Dakota, Oklahoma, Pennsylvania, Texas, Virginia, Wyoming). 

In fourteen other states, the deans reported to Professor Shepherd 
that the information was available on request (Alabama, Connecticut, 
District of Columbia, Iowa, Kansas, Kentucky, Michigan, Missouri, 
Nebraska, New Jersey, New York, Ohio, Oregon, Washington). 

In four states, the deans replied to Professor Shepherd that the 
information was not furnished on request (Arkansas, Georgia, North 
Carolina, Tennessee) . 

In order to check what progress had been made in releasing bar 
examination statistics since Professor Shepherd sent out his question- 
naires to the law schools two or three years ago, I sent out in August 
1952 questionnaires to the chairman or secretary of the boards of 
bar examiners of each of the states and territories. I was surprised 
to receive, so far, 46 replies. I want to thank you ladies and gentlemen 
present, and the representatives of your Boards, for answering the 
questionnaire. 

Of the seven missing, Professor Shepherd had information on 
three (Kansas, Oregon, and Washington), which I have included in 
the figures below. This leaves only three states and one territory as 
to which we have no information (Florida, West Virginia, Wisconsin, 
and Hawaii). 

The first question asked of the boards of bar examiners in my 
questionnaire was this: “Do you furnish statistics to each law school 
showing the success or failure of its graduates in your bar exam- 
inations?” 
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Fourteen replied yes (California, Colorado,* Idaho,* Illinois, Ken- 
tucky, Louisiana,* Massachusetts, Minnesota, New Jersey,* New York, 
North Dakota,* Puerto Rico,* Pennsylvania,* Virginia.* [The asterisk 
means the information is furnished only to law schools in the state. | 
In Puerto Rico information to out-of-state schools is available on re- 
quest. In Virginia such information is available to out-of-state A.B.A. 
approved schools.). 


Thirty-two boards reported that such information is available on 
request (Alabama, Alaska, Arizona, Arkansas, Connecticut, Delaware, 
District of Columbia, Georgia, Iowa, Kansas* | “*” indicates information 
obtained from Professor Shepherd], Maine, Maryland, Michigan, 
Mississippi, Missouri, Montana, Nebraska, Nevada, New Hampshire, 
New Mexico, Ohio, Oklahoma, Oregon,* South Carolina, South Dakota, 
Tennessee, Texas, Utah, Vermont, Virgin Islands, Washington,* Wyo- 
ming). 

Replies from two states were non-committal. In North Carolina, 
the secretary replied, “Law schools should be able to identify their 
students from such list (of those passing) .” In Rhode Island, the secre- 
tary replied that while the information is not available on request, the 
court might permit it to be released if it would contribute to the 
subject of bar examinations. 


Another question on the questionnaire recently sent out to all the 
boards read: “Do you furnish to each law school a list of the names 
of its graduates who passed and those who failed your bar exam- 
ination?” 

Twelve boards answered yes. (California, Colorado,* Idaho,* IIli- 
nois, Kentucky,* Louisiana,* Minnesota, New Jersey,* New York, 
Pennsylvania,* Puerto Rico,* Virginia.* |The asterisk means the infor- 
mation is furnished only to law schools in the state.] In Puerto Rico 
information to out-of-state schools is available on request. In Virginia 
such information is available to out-of-state A.B.A. approved schools.) . 

In twenty-eight states and two territories a list is available on 
request to each law school, showing the names of its graduates who 
passed and failed (Alabama, Alaska, Arizona, Arkansas, Connecticut, 
Delaware, District of Columbia, Georgia, Iowa, Maine, Maryland, 
Massachusetts, Michigan, Mississippi, Missouri, Montana, Nebraska 
Nevada, New Hampshire, New Mexico, Ohio, Oklahoma, South Caro- 
lina, South Dakota, Tennessee, Texas, Utah, Vermont, Virgin Islands, 
Wyoming). 

Professor Shepherd reported from his survey that deans in twelve 
states are informed of the rankings of the various law schools in the 
bar examination (Arizona, California, Colorado, Illinois, Indiana, Lou- 
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isiana, Massachusetts, Minnesota, Oregon, Pennsylvania, South Caro- 
lina, Virginia). 

In four states, Professor Shepherd stated that the information is 
supplied in considerable detail (California, Indiana, Louisiana, Penn- 
sylvania). 

Answers to the questionnaires recently sent by me show that very 
detailed information is now furnished to the law schools by the boards 
of eleven states. 

Ca.irornia.—Professor Shepherd reported that the law school is 
furnished “with the average percentage grade of all its graduates in 
each subject covered by the examination, and the average grade of 
graduates of other schools, the latter, however, being coded so as not 
to reveal the name or identity of any individual schools.” 


A copy of the printed statistics furnished by the California board 
to each law school lists accredited and unaccredited California schools, 
with the number and per cent of those passing and failing from each 
school, and tabulating the applicants according to whether they are 
first-timers or repeaters. The same information is also listed as to 
approved out-of-state schools. There are also shown comparative 
statistics from 1934 to 1951, listing the number and per cent of first- 
timers passing. There likewise appears the per cent passing of Cali- 
fornia A.B.A. approved schools and unapproved schools, and A.B.A. 
approved out-of-state schools. 

Co.orapo.—Here each local school is furnished with a list of names 
of graduates passing or failing the bar examination, and their grades, 
and a comparative table showing the average grade in each exam- 
ination subject of graduates of the three local schools. 

Int1no1s.—In addition to furnishing each school with a list of 
names of its graduatés passing and failing, the secretary reports that 
complete statistics are furnished to each school as to its own grad- 
uates. 

Inp1ANA.—A chart is sent to each law school in the state showing 
the grades given to each applicant in each question, listed by subjects. 
Applicants are listed as graduates of particular schools, and not by 
name. 

Kentucky.—A letter from John E. Richardson, Chairman of the 
Kentucky State Board of Bar Examiners, stated that each Kentucky 
law school is furnished with a list of its graduates passing and failing, 
and their grades, so that, as Mr. Richardson says, “the schools can 
analyze the results of their method of teaching and thereby correct 
their weaknesses.” 
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Lovuis1ana.—Here a list is furnished each school, showing the 
names of its graduates passing and failing. As to those failing, the 
subjects failed by them are tabulated. 


MassacHusETtTs.—Here statistics are furnished to each law school 
showing the success or failure of its graduates, and whether they are 
first-timers or repeaters. The names of those passing and failing from 
each law school are available to each law school on request. The 
printed list sent to each law school in the state shows the number 
of applicants from every law school, their success or failure in the 
examination, and how many are first-timers and repeaters. 

New Jersey.—Rutgers Law School, the principal law school in 
the state, is furnished statistics showing the success or failure of its 
graduates, and the names of those passing and failing. It is also 
supplied with a tabulation showing the success or failure of graduates 
of other law schools. Our experience has been that the furnishing of 
these statistics to Rutgers Law School has been a strong factor which, 
under the leadership of Chief Justice Arthur T. Vanderbilt and Dean 
Alfred A. Clapp, has resulted in a considerable tightening of standards 
at the Law School, and a consequent sharp increase in the per cent 
of Rutgers graduates passing the bar examinations. A new A.B.A. 
approved New Jersey school, Seton Hall Law School, has been in 
operation for only a year, so that none of its graduates has yet taken 
the bar examination. The release to the New Jersey Supreme Court 
of statistics showing a low degree of success of two other New Jersey 
law schools has been instrumental in causing the revocation of the 
the charters of these two schools, so that they are no longer in oper- 
ation. A rule of the New Jersey Supreme Court permits only A.B.A. 
approved law schools to operate in New Jersey. 


PENNSYLVANIA.—Each Pennsylvania law school is furnished with 
a tabulation of the success or failure of both its graduates and those 
from other schools, as well as a list of names of its graduates who 
passed and failed. The list showing the percentages of all law schools 
is available on request to out-of-state law schools. Applicants are also 
listed as first-timers or repeaters. 


Vircinia.—Here, also, schools in the state are furnished a list of 
names of its graduates passing and failing the examination. Statistics 
are not supplied to one school relating to the success or failure of 
graduates of other schools. 

Stuart B. Campbell, President of the Virginia Board of Law Exam- 
iners, explained in a recent letter the excellent relationship between 
the Board and the law schools. He wrote: “The Virginia Board meets 
after each examination with the faculties from the four approved law 
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schools in the state, and goes over the examination question by ques- 
tion. This is done during the progress of grading papers and the opinion 
of the law faculties is given due weight in grading any doubtful 
question, or in grading answers as to which they may be in doubt.” 


New York.—In this state, particularly detailed statistics as to the 
bar examination are released to each law school. Every law school is 
furnished the names of its graduates passing and failing. 


A copy of the latest such tabulation released by the New York 
Board to all law schools follows: 


Success of Graduates from Various Law Schools on the July 1951 Bar 
Examination in the State of New York and the Correlation Between 
Their Law School Averages and Their Grades on the Bar Examination 


(The symbol “100*” designates schools with 100 or more 
candidates; “30-100” designates schools with more than 
30 and less than 100 candidates.) 


Percent Passing by Groups 
Correlation Based on Law School Averages 
Law School Percent Passing with BarExam. High25% Middle50% Low 25% 


SUBSTANTIVE EXAMINATION 


A (100*) 81 .668 100 90 50 
B (100*) 79 642 100 83 46 
C (100*) 77 652 100 82 48 
D (100*) 76 593 97 77 48 
E (100*) 65 .696 100 71 30 
F (100*) 59 598 89 61 17 
G (100*) 54 699 90 52 17 
H (100*) 40 675 81 35 9 
I (30-100) 85 568 100 94 47 
J (30-100) 72 .678 100 69 

K (30-100) 74 ' 694 100 84 32 
L (30-100) 67 .640 100 66 29 

ADJECTIVE EXAMINATION 

A (100*) 77 591 94 87 45 
B (100*) 76 564 94 79 46 
C (100*) 76 539 97 83 41 
D (100*) 75 650 100 80 39 
E (100*) 64 645 100 69 30 
F (100*) 67 643 94 70 28 
G (100*) 75 633 100 73 37 
H (100*) 40 662 81 29 18 
I (30-100) 87 A491 100 94 58 
J (30-100) 84 630 100 88 62 
K (30-100) 71 717 100 72 42 
L (30-100) 66 652 100 66 29 
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Our Chairman, John T. DeGraff, who is President of the New York 
Board of Law Examiners, stated in a recent letter: 

“We furnish to each law school the figures showing the success 
or failure of the graduates of that school in comparison with other 
schools, but the information is coded so that each school is advised 
of its own result, but does not know the identity of the results 
published from the other schools.” 

A study of the statistical table released by the New York Board 
of Law Examiners to each law school shows that it is particularly 
helpful in obtaining a double appraisal: (1) of how well each law 
school is keeping up its standards, (2) of how well the bar examiners 
are keeping up their standards. 

The per cent passing from each law school is listed, in order to 
show each school how its percentage compares with that of other 
schools. By coding the name of the law school as A, B, etc., and telling 
a particular law school only its own code letter, the advantages of a 
comparative study are obtained, while keeping the name of the schools 
anonymous. 

In addition, by correlating the success on the bar examinations of 
graduates of each school with their records in law school, a check is 
made of the effectiveness of the bar examination. For instance, in 
School A, 81 per cent passed the substantive part of the bar exam- 
ination. Of the graduates of School A who were in the top 25 per cent 
of their class in law school, 100 per cent passed this part of the bar 
examination. Of graduates of School A in the lowest 25 per cent of 
their class in law school, 50 per cent passed this part of the bar exam- 
ination. 

In addition, the percentage of correlation is worked out through a 
formula explained by our Chairman in an address delivered before 
The National Conference of Bar Examiners in St. Louis in 1949. The 
address appears in the July 1950 issue of The Bar Examiner, at p. 147. 

The table shows an excellent correlation between the records 
of the men in law schools with their records on the New York bar 
examinations. 

The topic of our Chairman’s address was “Methods of determining 
whether a bar examination or a bar examination question is good, bad 
or indifferent.” 

In this address, our Chairman gave some illustrations showing 
the value of the statistics correlating law school records with bar exam- 
ination results. One instance was that of a school whose average of 
success on the practice and procedure part of the examination had 
dropped about 30 points below its average on the previous examination. 
When our Chairman discussed this performance with the law school, 
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he learned that the professor who had conducted the course in practice 
for many years had left the school and a new man had taken over. 


In another case in New York, the Board found that the general 
average of success of a certain law school had dropped steadily over a 
period of years until only 25 per cent of its graduates were passing the 
examination. A new dean was appointed, and the change in standards 
and faculty was reflected in a steady increase in the average of success 
until this school caught up with the others. 


On the other hand, statistics may show that the fault lies, not with 
the law school, but with the bar examination. For example, the figures 
listed in the annual compilation prepared by The National Conference 
of Bar Examiners show that the average of repeaters is considerably 
lower than that of first-timers. (The 1951 compilation appears in the 
July 1952 issue of The Bar Examiner, p. 140.) Hence, as our Chairman 
points out (p. 148 of the July 1950 issue), if the number of repeaters 
is substantial, and their average of success is higher than that of the 
first-timers, the variance is a danger signal indicating that something 
may be wrong with the examination. 


Here is another test discussed by our Chairman (p. 154): “If the 
examination functions well when correlated with law school averages, 
individual questions may be tested by correlating them with the exam- 
ination as a whole.” Hence, if, on a particular question, high marks 
were given to the poor students and low marks to the good students, 
the question can be considered defective. 


CoNCLUSION 


A high degree of cooperation between the bar examiners and law 
schools of a state is necessary in order to raise standards for admission 
to the bar. The bar examiners should pass on to each law school statis- 
tics as to how the graduates of every law school did on the bar exam- 
ination, and giving the names of those graduates of the particular 
school who passed and failed. Each law school should then furnish to 
the bar examiners the general average of each graduate who took the 
bar examination, and his position in his class, for example, grade 80 
or 20th in a class of 200. With this information, the law schools and 
bar examiners can check whether there is the proper correlation 
between the law school record of its graduates and their average of 
success in the bar examination. 


In the interest of raising standards for admission to the bar, each 
board should have a detailed system of bar examination statistics 
which it should release to each law school whose graduates have taken 
the bar examination. Many states have such a system. If they don’t, 
they should adopt a method of releasing bar examination statistics to 
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the law schools in a form similar to the table sent out by the New 
York Board. 


This form commends itself for several reasons. First, it shows the 
average of success of the graduates of each school whose graduates 
took the bar examination. Second, it shows each school how well its 
graduates did on the bar examination as compared with the graduates 
of other law schools. Thus, a law school with a poor average has an 
incentive, by comparing its average with schools which did better, to 
do better itself. Third, by correlating law school grades with the bar 
examination average of success, it checks on the effectiveness of the 
bar examination. 


As Professor Shepherd pointed out in his report for the Survey 
of the Legal Profession on Bar Examinations and Requirements for 
Admission to the Bar (p. 381), “the mere assembly of reliable statis- 
tical information over a period of years would afford valuable informa- 
tion now lacking in most states for an intensive study and improvement 
of the whole system.” 


Independent Evaluation of Bar Examination 
Grading at Five-Year Intervals 
By Frep M. Mock 
Chairman, Oklahoma Board of Bar Examiners 


Every man owes some of his time to the upbuilding of the profes- 
sion to which he belongs. That is why we are here in San Francisco. 
That is the reason for the existence of The National Conference of Bar 
Examiners. In preparing this paper, I had occasion to recall the objec- 
tives of this organization which were emphasized as early as 1931. It 
was then said that the Conference was formed for the purpose of 
increasing the efficiency of the State Boards in admitting to the bar 
only those candidates who are fully equipped, both from a standpoint 
of knowledge and of character, to serve as lawyers, and also to study 
and co-operate with the other branches of the bar in dealing with 
problems of legal education. Thus we see, that it was the early con- 
viction of the founders of this organization that success would depend 
upon a united effort of the courts, the law schools, and those lawyers 
in the various states charged with the responsibility of admissions. 

In one of the first issues of The Bar Examiner the scope and pur- 
poses of this organized effort to improve legal education was stated as 
follows: 

“In the first place, we believe that the examiners as a whole 
recognize the desirability of improving the standards of general 
education and legal training of candidates for admission to the bar 
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in many states where these standards are still low. In the second 
place, there is no doubt that much can be done to bring about more 
thorough investigation of the character of the applicant for admission 
to the bar. In the third place, a great deal can be done to improve 
present methods of ascertaining the knowledge and fitness of candi- 
dates who have been admitted to the bar of some other state and 
apply for admission on motion. In general, of course, the objective 
of improving the quality of bar examinations as a whole and their 
reliability as tests of the legal knowledge of the candidates must be 
kept in mind as of paramount importance.” 


For more than twenty years the prime objective has been to im- 
prove the quality of bar examinations and their reliability as tests of 
legal knowledge. 

Now, has that prime objective been accomplished? Certainly, in 
the larger states and in those localities where the founders of this 
organization live and work, great and important strides have been 
made toward the intended goal. But how about the other thirty-five 
or forty states which have a completely amateur, short-term, rotating, 
usually unpaid Board of Bar Examiners, operating sometimes under 
a worn-out and archaic system? 


To answer the question as to whether the prime objective men- 
tioned above, has been accomplished, I can say that as to Oklahoma, 
an area which is just as far removed as possible from these other 
areas of aggregate wisdom, I can report that progress is being made. 
The efforts of this section of the American bar are bearing good fruit 
in my state. The Supreme Court of Oklahoma, the thinking lawyers 

‘of Oklahoma, and the Board of Bar Examiners of that state are con- 

vinced that improving the quality of bar examinations and making 
those examinations reliable tests are of great importance to the im- 
provement of the profession. Certainly, in my state the values to be 
gained from periodic surveys of the bar examination systems of the 
various states is recognized. 

In the Consultant’s Report it is suggested that at intervals of four 
or five years a committee of law school teachers should be appointed 
to make an independent check on the grading of the readers. The 
members of the committee, it is suggested, should grade a cross-section 
of the answers to questions which are in their respective fields. From 
ten to fifteen per cent of the answers should be regraded, and the 
regrading should have no effect whatsoever on the grades originally 
given by the official readers or examiners. The purpose of the regrad- 
ing is to check the work of the readers or examiners to determine 
whether or not the work being done is accurate. It is further suggested 
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that in selecting the papers to be regraded, care should be taken 
to include answers which have received high grades, low grades, and 
average grades. Any marked difference in the grades assigned by a 
reader or an examiner and, the grades given by a committee man should 
be carefully checked to determine whether or not the reader has done 
accurate work in grading the answers to the questions assigned to him. 

Many papers have been written, many discussions had, and this 
Conference has concerned itself with the selection and qualification of 
the examiners, and with the type of question to be asked on a law 
examination. Certainly, those are relevant problems to the overall 
objectives. I would suggest that concerning ourselves with the qualifi- 
cations of the examiners and the type of question in a proper law 
examination is just a half job toward the goal of improving the quality 
of bar examinations. Must we not go one step further and make a 
thorough, statistical check of the results? 


Surely we can agree that the average bar examiner is not trained 
to do everything for all people. The average bar examiner is a success- 
ful practitioner, probably a specialist in some field of the law, who 
takes on the job of being an examiner as a duty which he feels he owes 
the profession. He takes only the time from his business that is neces- 
sary to prepare the questions, give the examination and then grade 
the papers. The grading of the papers is usually done on a “catch as 
catch can” basis, against a time deadline. He is not trained as a 
teacher of the law, and as between a number of examiners, nine in my 
state, there is not and cannot be any unanimity of method or effort 
in grading answers to examination questions. 

During my tenure on the Board in Oklahoma, we have had one 
examiner, a fine and successful lawyer, who had his own positive and 
unique method of grading. He divided the papers in his two subjects 
and gave half of the applicants 100 or a perfect grade, and the other 
half a grade of 95. This examiner and the methods he seemingly used, 
exemplify an exaggerated example of the need for an independent 
check on the grading of the examiners or readers. 

From my contact with Mr. Brenner and Mr. Farley, I know that 
California has a system of evaluating examinations every five or six 
years. It is called an audit. A committee for cooperation between the 
law schools in California and the State Bar is appointed. This com- 
mittee, composed of law school deans, members of the Committee of 
Bar Examiners and lawyers and judges, supervise these audits. Ordi- 
narily, one question from each subject in the examination is selected 
for review, and fifty answers to each such question are regraded. In 
the 1951 audit a more concentrated appraisal has been made and each 
of the twenty-four questions in the examination has been reviewed 
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and one hundred answers to each question have been regraded by 
the reviewing professors. The data on this 1951 audit are not yet 
available for publication. 


In selecting the twenty-four professors to perform this important 
work, the Committee of Bar Examiners of California endeavored to 
obtain men who had taught the particular subject for several years 
and to have each California law school represented in proportion to 
the number of its full-time faculty members. 


Each professor of law selected was requested to give a critical 
appraisal of the suitability of the question for use in the bar examina- 
tion, to study and evaluate the various analyses and other material 
used by the official grader for the Committee of Bar Examiners, and 
then finally to grade or consider one hundred answers and to give his 
appraisal of the grades given these answers by the official grader. 


Each of the law professors selected to make this appraisal were 
asked these specific questions: 


1. Does the question you are appraising differ significantly, in 
either the content or form, from the kinds of question you 
use in your examinations? 

2. Do you think a man or woman who is ready to practice law 
ought to be able to answer this question? 

3. Was the content of this question covered in a course or 
courses offered to graduates of your school who took the 1951 
bar examination? 

4. Is the content of this question covered in a course or courses 
now offered to students in your school? 

5. Was this question too tough for “C” students, and was time 
enough allowed-for a satisfactory answer? 

6. Could a student write a satisfactory answer if he had success- 
fully passed a course for which one of the leading case books 
in this field had been used? 

7. If you had a full time job at a law office, at what rate per 
day or per week could you conscientiously grade one thou- 
sand of these answers? 

8. Do you think questions like the one you are appraising are 
likely to arise in the actual practice of the law in California? 

The one hundred sets of answers were selected to represent, as far 
as practicable, a cross-section of the entire examination. Thirty-eight 
of the sets were passing papers. That represents about the percentage 
of those passing the examination. The answers appraised were those 
of applicants who attended fourteen California law schools, and Har- 
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vard, Michigan and Yale. Fifteen sets of answers were selected of 
applicants from each school having 100 or more taking the examina- 
tion; ten sets of answers of applicants from each school having 50 to 
99 applicants taking the examination; five sets of answers from each 
school having 25 to 49 taking the examination; and three sets from 
those schools having less than 25 applicants. That method insured a 
composite picture. The answers were also selected so as to have a 
proportionate number of those barely passing and of those barely 
failing, as well as some with high grades and some with low grades. 


With such an appraisal by experts in the field of legal education, 
California will be able to answer the question, “Are bar examination 
answers accurately graded?” With such an appraisal by experts in 
the field of legal education in your state and in my state, we, too, 
can determine whether or not the reader or examiner has done accu- 
rate work. 


We can certainly all agree that the need of a periodic appraisal 
of grading methods is necessary. Will the California system work in 
your state? In Oklahoma we do not have readers. We do not have a 
committee to prepare questions. It is the duty or the job of the Board 
of Bar Examiners to pass on the qualifications of all those entering 
upon the study of law, and to prepare the questions, give the examina- 
tion, and grade the answers when the examination is given. I might 
add that we also sweep out the office. I dare say that in a great major- 
ity of the states the same situation exists. Also, the same problem 
exists, the same urgent need for a comprehensive appraisal of the 
grading technique. So, it seems to me that this problem is worthy of 
our attention. Some appraisal system should be put in operation in 
every state. Use your law faculty; those men are trained in the field 
of legal education, and will be ready and willing to serve you and 
your Bar Association. By such cooperative effort the quality of bar 
examinations will be improved, and their reliability as tests of legal 
knowledge will be more firmly established. 


Bar Examination Boners 


1. If the attorney wants to convey to the jury the fact that his 
witness has changed his testimony, the attorney can say, with sarcasm, 
“So you are a witness.” This is his only remedy. 


2. Murder in the second degree is the killing of a person with 
premeditation and deliberation but with no intent to kill. 


3. The very fact that he shot the officer when told to hold up his 
hands shows a mean spirit on the part of the prisoner. 
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GoscoE O. FARLEY 


Mechanics of Giving Bar 


Examinations* 


CHAIRMAN JOHN T. DeGrarr: The next panel discussion is un- 
usual, both with respect to its subject matter and its participants. The 
subject matter is a very down-to-earth, practical subject, “Mechanics 
of Giving Bar Examinations.” After having over the years so many 
high-flown speeches about the theory of examinations, we are now 
coming down to the real, practical, day-by-day job of giving them. 


The speakers are as unusual as the subject matter. You have 
heard reference this morning to the fact that a bar examiner is a 
person without friends. That is all too true. Under those circumstances, 
it would not be expected that any bar examiner would win a popularity 
contest. It would be much more unusual if he were to win a pop- 
ularity contest among law students. Yet the first person on the pro- 
gram, Goscoe O. Farley, has the unique distinction of being elected 
“Man of the Year” by the Association of the Law School Students of 
the State of California. On my right is Marjorie Merritt, who has won 
the unanimous award of the Conference of Bar Examiners as the 
“Woman of the Year,” not this year but every year in the twenty-one 
years of our existence. 


Marjorie and Goscoe have been studying, over the past week-end, 
the techniques of Weber & Fields and Mr. Gallagher and Mr. Sheehan, 
and to make a variation in our program they are both going to address 


* An informal discussion at the annual meeting of The National Conference 
-of Bar Examiners in San Francisco, September 16, 1952. 
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you simultaneously on the subject of mechanics of giving bar exam- 
inations. 


Panel Discussion by Goscoe O. Farley and Marjorie Merritt 


Goscoe O. Fartey: Mr. Chairman, members of the Conference: 
The students neglected to tell me whether I was the best man of the 
year or the worst man of the year! 

Marjorie and I have prepared a little dialogue. She is going to 
answer some of my questions, and I am going to try to answer some 
of her questions. 

It seems to me that the method of giving a bar examination is 
going to depend on the size of the group taking it. Certainly a method 
that would do for 15 or 20 might not be satisfactory for 100 or 200. 
I think we should pretend that we are going to give the examination 
to a fairly large group, because the details are going to be more 
involved, naturally. We are going to pretend there are at least 100 
applicants. 

Marjorie, let’s assume that the questions have already been pre- 
pared and the applications processed. This should be done at least 
a couple of weeks before the examination. Our job simply will be to 
administer the examination and to get the books into the hands of 
the readers. 

Margorie Merritt: Well, Goscoe, what shall we do next? You 
know, two weeks isn’t very much time. 

Mr. Fartey: You are right. It isn’t much time. Unless a bar exam- 
ination is planned well in advance things are not apt to go very 
smoothly. We usually engage the examination rooms about six months 
in advance, but before we sign the rental agreement for the room, 
Marjorie, we will have to decide whether to permit typing, because 
that will require another room. 

Do you know what other states are doing about typing? 

Miss Merritt: In boning up for this discussion to try to compete 
with the Man of the Year, I checked all the questionnaires in Mr. Bren- 
ner’s monumental Survey of the Legal Profession, and I found that 
eighteen states permit the use of typewriters; eight said they would 
allow the use of typewriters if the applicants were physically handi- 
capped; ten states simply said no. 

I think it was in Texas where they solved the problem neatl; 
They set up typewriters and tables from all over town and every 
express wagon was busy bringing in the equipment. The examiners 
blocked off a long corridor in the state capitol for the typewriter section 
so the applicants could type away there without bothering applicants 
taking the examination in other rooms. 
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But it seems to me that typing may give an advantage over the 
student who writes in longhand. What do you think about that, 
Goscoe? 

Mr. Fartey: I think it is doubtful that the typist has an advan- 
tage. We have permitted typing in California for about twenty years. 
About twenty-five per cent of our applicants type. I notice that 
usually the highest grades in the examination are achieved by those 
writing longhand. 

Several years ago we computed the percentage of those typing 
who passed, and compared it with the percentage of others, and the 
ones writing longhand had the higher percentage. The figure may 
be misleading, however, because a higher proportion of those attend- 
ing night law schools type, and on the whole night students do poorer 
in the examination, as one would expect. 

Many law schools permit typing of law school examinations, and 
consequently we have many applicants who are accustomed to taking 
examinations by that method. I believe it should be permitted. 

There was one applicant taking our examination who found that 
even typing wasn’t fast enough. About half way through the last 
question he typed “Time running out,” and this was followed by 
several pages of shorthand. We decided that the privilege wouldn’t 
be extended to shorthand. 

Miss Merritt: I hope, Goscoe, that no one asks you to furnish 
him a tape recorder. 

The picture of your applicants taking the bar examination here 
in San Francisco was on the cover of The Bar Examiner. It showed 
that you furnished adequate tables for the applicants to use, and good 
straight chairs. In some of the states I have visited they furnish 
simply those cafeteria, or coffee-and-sandwich, one-armed chairs. It 
seems to me that such a chair is hardly sufficient to take care of 
examination papers. What do you think? 

Mr. Fartey: I certainly agree. It is hard enough to take a three- 
day examination sitting at a good desk. 

Miss Merritt: All right, now that we have rented some office 
space and have some good chairs and tables for the boys, what do we 
do next, Goscoe? 

Mr. Fartey: As soon as we know the approximate number who 
will take the examination we should order the examination books. 

Miss Merritt: What do you do, and how do you figure out how 
to order the examination books? 

Mr. Fartey: For one thing, you are going to have to determine 
how many books to use for each applicant. Are you going to have 
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him write each answer in a separate book, or are you going to have 
a number of answers in each book? 


At times we have tried having a number of answers written in 
each book. The advantage, of course, is that there are fewer books 
to handle, and if hundreds are taking the examination this is a con- 
siderable saving. 

But the disadvantage is that if you have different readers grading 
the different questions in the book, you are going to have to circulate 
the books among the readers, and this is apt to slow up the grading 
process. If one reader gets behind it is apt to slow up the other 
readers. At present we use a separate book for each question in the 
examination. 


One thing I have found helpful is to use books of different colors. 
This makes it easier to distribute the books and pick them up later on. 
It makes it easier to get them out in the hands of the graders. 

Another thing, I would have plenty of pages in each book, so even 
the most prolific writer doesn’t run out of paper. 

Miss Merritt: I think in many states the applicant is given just 
one book for one session of the examination. Exactly how the exam- 
iners divide the answers when it comes to the grading, I haven’t been 
able to determine, especially when the men write on both sides of the 
paper and so on. 

I have been wondering if there could be some system of using 
loose-leaf sheets fastened together, which could be separated after the 
bar examination. 

Mr. Fartey: Marjorie, I have had some experience with that, 
too, and it seems to me there is too much danger of getting the pages 
mixed up. If each page isn’t identified carefully, you may get the 
pages written by various applicants mixed. And another thing about 
that system, an applicant might end an answer on one side of the sheet 
and begin the next answer on the other side. So you can’t separate 
them. 

I think one of the most important things about the books is to 
have some system to preserve the anonymity of the examinees. I think 
we all agree that no reader should know the identity of the person 
whose book he is grading. 

What methods do some of the other states have for this, Marjorie; 
do you know? 

Miss Merritt: I remember one system. When the applicant 
walked into the examination room he was handed an envelope with 
a blank slip of paper in it. There was a number on that slip of paper. 
He signed his name on the slip, put the slip in the envelope, sealed 
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up the envelope and turned it in to the examiner at the very begin- 
ning of the examination. Then he began writing his paper, and of 
course he put his number on that paper. 


Sometimes the secretary of the examining board keeps a list of 
applicants, and a number is assigned to each applicant as he comes in 
the examining room. Then only the secretary knows whose name 
belongs to each number. 


How do you do it here in the great State of California, Goscoe? 

Mr. Faruey: ~ As each applicant applies he is given a number in 
sequence, which we call the Application Number. A week or so before 
the examination, we send him an admittance card, and this card has 
his application number on it. Then, in the examination, he is in- 
structed to write his application number on the stub of the upper 
righthand corner of each examination book. As soon as the exam- 
ination is over we stamp a new number on the book, which we call the 
code number. And then we tear off the stub from the book, and the 
book is thereafter identified only by the code number. We lock up 
the key to the code in the safe, and it is not removed until the grading 
is all completed. 


Miss Merritt: Do you hand the applicants instructions prior to 
taking the bar examination or when they come in to take the exam- 
ination? 

Mr. Fartey: We do both. A week or two before the examination 
we send them their admittance card and a letter. We tell them exactly 
where and when to come, and we tell them what to bring and what 
not to bring. We give them the general set-up of the examination, the 
number of questions, how many they will have to answer at each 
session, etc. 


One of the important instructions at this point, I think, is to tell 
them to come about twenty minutes early. The reason for this is that 
we distribute printed instructions at the first session, and unless they 
have plenty of time to read and study these instructions they are 
not apt to follow them. You can’t pass out instructions at the same 
time you do the questions, if you want the instructions read and 


followed. 


Miss Merritt: I know that in a number of states I have visited 
they schedule the first session perhaps fifteen minutes to a half hour 
earlier than the other sessions, to give the applicants an opportunity 
to read the instructions as to how they are expected to answer the 
questions and so on. 

Mr. Faritey: Now that we have the books and the instructions, 
Marjorie, let’s decide where we are going to give the examination. 
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I think in many states it is given in the chambers of the legislature. 
Do you know how this works out? 


Miss Merritt: I have been visiting state boards since they have 
had such large numbers of applicants, and some of the facilities have 
been rather inadequate. I was interested in one state’s system of 
seating the candidates which caused a great deal of confusion. There 
were about eighty applicants. Some of them were to sit in the Senate 
Chambers, some in the House of Representatives, and the remainder 
in the state library, all under one roof. When the session began a bar 
examiner stood up and said something like this: “All applicants with 
last names beginning from ‘A’ to ‘D’ are to sit in the House of Repre- 
sentatives, and all applicants whose last names begin with ‘E’ to ‘M’ 
are to sit in the Senate Chambers; the rest of you go in the state 
library.” 

I was standing among these eighty applicants, and all I could 
hear, for example, was Joe Dokes saying, “Did he say ‘A’ to ‘B’ or did 
he say ‘A’ to ‘D’?” And that occurred with many in the room. So I 
think that an alphabetical system of seating or segregation is wrong, 
at least if the divisions are given verbally. In that particular case, it 
took about half an hour to get the applicants seated as intended. 


I will mention one state by name, because I thought the exam- 
iners did a fine job of seating applicants; that was the good State of 
Ohio. In Ohio they had a number on each table, as I remember it. 
They had a large group, over 100 applicants, and they had adequate 
tables, very well spaced. Then each student already had or was given 
a number as he came in the door, and the examiner said: “Now, you 
each have your number. There is a number on a table. There are 
about ten rows of tables, with about ten seats to a row, so if your 
number is 69, count the rows from the left, and there in the sixth row 
you will find number 69. Take your places, please.” Everybody found 
his place promptly and got to work, in spite of the fact that it was 
the day the Korean war news broke. 


How do you handle your seating arrangements, Goscoe? 

Mr. Fartey: We have done it several ways, Marjorie. At one 
time we had a specified desk for each applicant. His number was on 
the desk. But if you have 300 or 400 in one room, it takes too much 
time for them to find their desks. So next time at least we are going 
to assign desks on a first-come, first-served basis. I think that will 
avoid confusion in getting the examination started. 

Speaking about the place of giving the examination, Marjorie, 
here in San Francisco we give the examination in the Native Sons 
Hall. You get it—“Native Sons’’? 
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Miss Merritt: Yes. 

Mr. Fartey: Applicants from out of state claim this is rank dis- 
crimination! 

In Los Angeles there is an emergency hospital right alongside 
the examination room. You would be surprised how busy this hospital 
is dispensing aspirin and smelling salts during the examination. 


Miss Merritt: I can suggest one way for cutting down the con- 
sumption of smelling salts and aspirin. This summer I served as 
proctor for a boy taking the examination when he was in military 
service. He was located there in Denver. The last session of the 
bar examination I had to give him was by far the most strenuous. 
He had twelve questions to answer on the optional subjects he had 
selected prior to the bar examination. The other sessions required 
answers to only nine questions. I felt sorry for that boy. Here he was, 
all worn out after five sessions, eight hours a day for three days, 
trying to answer the hardest session last. 


It seems to me that if you bar examiners know that one particular 
session is to be more difficult, you should schedule it as the second 
session or the next to the last session, at least not at the beginning 
or at the end. 

Mr. Fartey: Here is a question I am interested in, Marjorie. 
What can be done to prevent an applicant from hiring somebody else 
to take the examination for him? Do you know of any precautions 
taken by other states? 

Miss Merritt: I have heard rumors and rumors, but I saw only 
one possibility during my visits. One bar examiner had a tip that 
another person was coming to take the examination for an applicant. 
The examiners had the photographs of all applicants, so after the 
examination session began one of the examiners walked up and down 
the aisle between the candidates, with one photograph behind his 
newspaper. He looked sharply at each of the boys and finally found 
the right one, so the rumor was a false alarm. 

It seems to me that, if you have the applicant sign his name on 
a card when he begins the examination, you can compare his signa- 
ture with the signature on the application card. Or if you require the 
applicant to fill out his application in his own handwritng, you can 
compare that handwriting with the handwriting in the bar exam- 
ination. I can’t see any advantage of photographs over handwriting. 
What do you think? 

Mr. Fartey: It depends on whose photograph it is, Marjorie. We 
don’t use photographs, however, in California. 
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At the time a student starts to study law he must register with 
our Committee. He has to sign his name before a notary public, and 
again when he applies to take the bar examination. At the time he 
actually takes the examination we again get his signature. And these 
signatures can be compared. The signature we get on his registration 
three or four years before he takes the bar examination can almost 
certainly be depended upon to be genuine. 


Another precaution we take is to fingerprint each applicant and 
to have him sign the fingerprint card. These cards are filed with the 
FBI. It is true that an impostor could submit fingerprints in the name 
of an applicant, but the fact that the prints are going to be filed with 
the FBI would probably deter him. If his fingerprints are not on file 
already with the FBI, they probably will be in the future. 


Miss Merritt: We have been investigating an applicant, and 
we sent for his fingerprints. They were very well smeared and, 
believe me, we found out why, too. 


Speaking of impostors, Goscoe, do you know of any good system 
for preventing cheating? 


Mr. Faruey: I don’t think cheating happens very often. The only 
methods I know of are to seat the applicants far apart in the room, 
and to have plenty of proctors. I think you should have at least one 
proctor for every forty or fifty applicants. I think it is well to have 
the proctor stand in the rear of the room. This way an applicant can’t 
know where the proctor is looking at the moment. 


I have an interesting story about cheating. A year or two ago 
one of our proctors noticed that an applicant—it was a very hot day, 
and the other boys had their coats off—this applicant had his coat on. 
And he kept looking into his inside pockets. We had an ex-police 
officer helping us with our proctoring, and we had him take the boy 
outside and open up his coat. It was crammed with notes which the 
boy had been reading. 


Although he knew he would be disqualified, the boy pleaded to 
be permitted to continue the examination so he wouldn’t have to 
answer embarrassing questions from his buddies. We permitted him 
to finish, and pending the formal hearing his books were graded the 
same as everybody else’s. Now here is the interesting thing: During 
the first half of the examination, when he was cheating, he failed to 
get a passing grade, but during the second half, when he wasn’t 
cheating but was under this intense emotional strain, he passed! 
Isn’t that amazing? 


Miss Merritt: I guess he couldn’t read his notes. 
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What is the rule regarding permission to leave the room during 
the bar examination? Do you allow only one person to go at a time, 
or do you have any system of that type? Do you require the applicant 
to complete his answers before he leaves the room? 


I was interested in a system in one state. Instead of giving all 
the questions at the beginning of each session, the examiner gave each 
applicant a sheet of paper containing about three questions and ample 
paper for answering them. The candidate answered those three 
questions, went up to the front of the room, left the answers and left 
the questions, and then if he wished he could go out of the room, the 
theory being that he had no questions and therefore couldn’t leave 
the room and have somebody else tell him the answers. But there was 
a steady parade going back and forth for questions; it was very con- 
fusing. 

Mr. Fartey: We let the applicants leave the room at will. We 
can’t limit it to one at a time, Marjorie, because we have a thousand 
taking it sometimes, and one out of a thousand would be too few! 
We don’t find the privilege abused. 


We have proctors outside in the corridors and rest rooms, so it 
is no easier to cheat out there than in the examination room itself. 

Miss Merritt: What do you do about the problem of coffee, 
candy, tea, smoking, and what have you? 


Mr. Faruey: I think it is best to open plenty of windows and let 
them smoke right in the room at their desks. This avoids the problem 
of applicants continually going out in the corridors to smoke. Coming 
or going is distracting to the others. Coffee we permit, and candy 
bars, and what not. 


Miss Merritt: Goscoe, do you think that the bar examiners 
themselves should be present at the examination, so that if there are 
any questions about the examination someone with intelligence can 
answer those questions? 


Mr. Fartey: We can’t have a bar examiner in each room here, 
Marjorie. We have only seven bar examiners, and we have ten rooms. 
Besides that, I am not a believer in making explanations during the 
examination. For one thing, you can’t make an explanation to an 
individual. That is not fair. You have to make a general announce- 
ment. This may easily lead to too many announcements during the 
examination. 

Another thing, you will often find that when you first hear of an 
ambiguity many applicants will have already started to answer that 
question. It doesn’t seem fair to make an announcement giving an 
official interpretation after many have started to answer the question. 
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Another reason that applies here in California is that we can’t 
make a simultaneous announcement to all applicants. We have them 
in two different cities, and within either city they may be in different 
rooms several miles apart. 


Rather than having the bar examiners sit for three days proctor- 
ing an examination, I think it would be better if they spent the three 
days before the examination ironing out the ambiguities. 


Miss Merritt: You are right, of course; they should take great 
care in drafting the questions, and have some criticism of them. But 
I noticed, in boning up through Mr. Brenner’s questionnaires, that 
eighteen states have no exchange of questions at all, apparently, and 
no criticism. To me, it seems that the person who drafts the questions 
can hardly be expected always to get all of the bugs out of the butter. 


I visited one examination where “Mr. Jones” in the first para- 
graph of a question had been changed to “Mr. Smith” in the second 
paragraph, and about six boys came up and asked about the where- 
abouts and the wherefores of Mr. Smith before the examiner said 
anything about it. And he looked at me and said, “This isn’t my ques- 
tion, and I don’t know what I should do about it.” 


I said, “I would stand up and make an announcement that ‘Mr. 
Smith’ should be changed to ‘Mr. Jones’.” 

In another examination the applicants came up and asked a great 
many questions about the questions, and the examiner proctoring 
the examination wasn’t familiar with the questions. I noticed that the 
boys, as they turned around to return to their seats, had one expres- 
sion on their faces, chiefly. It meant either, “That examiner surely is 
cagey” or “he is plain dumb.” 

It seems to me that, if you are going to permit the applicants to 
ask questions about something they consider ambiguous or strange 
beyond words, you should have a bar examiner familiar with the 
questions there to answer them. I saw another examiner, in this same 
state, answering very sympathetically and intelligently; the boys were 
very pleased with the examiner and he made a good impression. And 
as they left the examiner said to me, “My, what smart cookies these 
boys are!” 

I said, “Are these your questions? You seem to understand them 
and know all about them.” 

He replied, “No, but I spent all morning studying up on them so 
that I would know what they were about.” 

Goscoe, what do you think is the strangest thing you have ever 
seen in this bar examination procedure? 
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Mr. Fartey: Marjorie, that is a difficult question. Giving a bar 
examination is pretty serious business. I think the strangest is the 
one about the boy cheating, which I already told you. 

Although not a particularly strange one, perhaps I have an 
appropriate story at this point in view of our discussion of the care 
one must take to see that applicants receive good clear directions on 
where and when to appear for the examination, where to sit, what 
to bring, etc. 

Several years ago a proctor came up to me and said, “There is an 
extra man in this room taking the examination.” 

I went up to the stranger and asked his name. 

“John Brown.” 

I said, “Did you apply to take the examination?” 

“No.” 

“Did you pay the fee?” 

“No, but how much is it? I will pay whatever it is.” 

I said, “Have you been fingerprinted?” 

“No.” 

“Have you appeared before the Committee for personal interview?” 

“No.” 

“Did you receive instructions to come to the examination?” 

“No.” 

“Where did you get your examination questions and books?” 

“The proctor gave them to me.” 

I said, “How did you get here, anyway?” 

He said, “Well, I am a lawyer just out from New York; I read 
in the newspaper last night that you were giving a bar examination, 
so I thought I would come down and take it.” 


Miss Merritt: Well, Goscoe, I think maybe that is another 
example of the power of the press. And, in other words, Goscoe, after 
all our red tape and all our plans in advance for conducting a bar 
examination, mechanics of giving a bar examination may be entirely 
unnecessary! 


General Discussion 


CHAIRMAN DeGraFF: We have just about five minutes, if you 
would like to ask questions of either of the two panels still available. 

Epwarp D. Re (Brooklyn, New York): I would like to ask a 
question of either of the members of the last panel. 
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For some years the law student associations have been spending 
quite a bit of time in deliberating as to whether or not the honor 
system instills appropriate characteristics of, let us say, honesty and 
integrity and does help the profession. As a matter of fact, at this 
convention there was one panel devoted to the honor system. Having 
heard so much very interesting material on cheating, I should like 
to ask if any state has either used or given thought to the honor 
system. 

Miss Merritt: Well, I know the applicant to whom I gave the 
bar examination in my office told me that it was strictly under the 
honor system. But I looked through the crack of the door once in a 
while. 

I don’t know how prevalent the honor system is in other states, 
but I think it is probably followed to a great extent, because I noticed 
in a number of states where I attended bar examinations that the 
examiners just sat up at the front of the room and read the morning 
paper, or maybe it was the Racing Form in Kentucky, and didn’t seem 
to pay much attention to the boys. I think we have to trust them 
pretty well. I still think the lawyers are all right. 


CLARENCE D. Puituirs (Portland, Oregon): I would like to in- 
quire, if an applicant was to hire a substitute to take the examination 
for him, what assurance would he have that the substitute might be 
capable of taking that examination and possibly passing it? That 
rather intrigues me, the matter of substitutes. 


Mr. Fartey: Is that a question? 


Mr. Puiiurps: Yes, how do they select these proxies? 


Mr. Faruey: I think it would be very difficult, myself, because 
anybody capable of passing the examination certainly doesn’t want 
to take a chance of ruining his reputation if he gets caught. So I think 
it is very remote that a sufficiently qualified proxy could be found, 
unless perhaps he is somebody that has been disqualified on moral 
character. 


Joun E. RicHarpson (Glasgow, Kentucky): Miss Merritt was 
referring to our examination in Kentucky where she saw the exam- 
iner reading the newspaper and looking around at the applicants. We 
had sufficient help to watch them, and we have caught some of the 
applicants cheating at times, and we have taken the numbers they 
have put on their papers, although we do not have many applicants 
that either give or receive aid during the examination. But we watch 
them. And we enjoyed Miss Merritt’s visit there very much. 

Miss Merritt: I wasn’t talking about you, Mr. Richardson, when 
I referred to reading the Racing Form. 
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